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SETTING UP A KEY SUCCESS INDEX REPORT: A HOW-TO MANUAL 



ABSTHACT 

A Key Success Index report presented to key administrators and covering a wide 
range of critical areas provides a "monthly checkup" that allows an institution to monitor its 
health. This paper will briefly describe the use of such a report at one institution and will 
provide suggestions, based on the author's experience, for institutional researchers who wish 
to set up such a report at their own institutions. Eight steps will be explained. Obstacles 
that may be encountered, answers to frequently asked questions, and benefits to the 
institution and to the institutional research office also will be discussed. 
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INTRODUCTION 

When higher education experiences hard times, colleges and universities need a way 
to monitor potential problems, A Key Success Index (KSI) report, updated on a monthly 
basis with information about high-priority operations of an institution, helps senior 
administrators track the "health" of a university or college throu3hout the year in order to 
identify at an early stage any unexpected variation from the prior year or from the budget. 
A KSi report, prepared unde: the auspices of the office of planning and institutional 
research, has been used at the University of Miami (UM) for five years. This paper will 
describe suggestions for implementation and administration of such a report by an office 
interested in setting up the report- 

The concept of "key success indicators" is similar to "critical success factors," which 
J. F. Rockart defiuaed as "the limited number of areas in which results, if they are 
satisfactory, will ensure successful competitive performance for the organization. They are 

the few key areas where 'things must go right' for the business to flourish As a result, 

the critical success factors are areas of activity that should receive constant and careful 
attention from management" (1979, p. 85). 

Although the CSF method arose in the business arena. Peat Marwick in 1988 
developed a model for higher education. The Peat Marwick model, which listed 67 critical 
success factors measured on a yearly basis, was designed for use by senior administrators 
and responded to the need to "compress information so that managers can focus their 
attention on high priorities in making and assessing decisions." Because of the differences 
between their measurements and traditional CSFs (e,g., monthly updates, more indices, use 
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of numeric institutional data), administrators at UM decided to coin anoth#*.r term for tlieir 
measurements: Key Success Indices (KSIs)* 

The KSI report has evolved into a document that is five pages long and focuses on 
the current year-to-date amount for each KSI and how it differs from the previous year's 
amount The report also includes the monthly data for the current and the previous year 
and, where applicable, the current budget for each KSL One hundred forty-two indices are 
obtained from 19 offices throughout the university. The report is prepared during the third 
week of the month and is circulated to members of the president's agenda committee a few 
days prior to the KSI meeting, where highlights of the report are discussed, including any 
major change from the previous year or from the budget. 

lins paper outlines eight steps needed to set up and to administer a KSI report. The 
approach used at the University of Miami is described, but alternative approaches also are 
suggested. 

STEPS IN SETTING UP THE PROGRAM 
Step l-Identifying an advocate. Because the report uses data gathered from the 
entire umversity, the first step is to identify someone at a senior level within the institution 
who has an interest in the report and who is willing to persuade his/her colleagues to 
support the collection of data for the report. At UM the impetus for the KSI report came 
from the senior vice president with responsibility for business and finance. In late 1987, he 
approached the office of planning and institutional research about developing a monthly 
report encompassing a broad range of performance indicators. His objective was to provide 
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a mechanism to bring senior management together in order to focus on changing trends in 
the quantitative fartors driving the university's future well-being. He had used a monthly 
report to monitor revenue and expenditure trends in an earlier job in private industry and 
thought a similar type of report would be useful to help identify changes in key areas of the 
university at an early stage. He also hoped that a report dealing with the broad range of 
university departm^^nts would help educate senior administrators about what was happening 
outside their own area of responsibility and would promote a team approach to 
management. The senior vice president's enthusiasm, commitment, and support were 
paramount m seUing senior administrators (some of. whom were not initially very 
enthusiastic) on the importance of the report. Also, when needed, he was effective in 
increasing cooperation from offices supplying the data. Finally, his perspective was 
important in designing the report. 

Step 2-SeIecting the indices to use in the report. In order to determine which 
indices to use, the director of planning and institutional research at UM informally 
interviewed several university officials and then combined their suggestions into an overall 
list. A special effort was made to include any areas that in the past had produced an 
unexpected negative impact on the budget. Subsequent discussions with contacts in key 
offices often led to changes and additional measurements- 

At the present time 142 indices are obtain-sd from 19 offices throughout the 
university (Table 1). The report focuses on simple, real measures such as numbers of 
incoming students, cash position, receivables, payables, spending on research, and 
continuing-education revenue. One important section that becomes most relevant during 
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the last several months of the fiscal year but is sometimes updated at earlier times as well, 
is the year-end forecasts. A set of measures an institution may wish to include in their KSI 
report (although it is not used at UM) is a calendar of deadlmes for events that are critical 
to the operation of the reporting offices. If a calendar is used, each report could include 
the deadlines for the preceding month and whether they were met or noL 

Although UM's list of KSIs has worked well for its purposes, it is important for each 
institution to select a set of measurements appropriate for its own use. The KSIs used in 
the report should be appropriate and accurate, and should measure high priority (key) 
operations of the institution. The following approach, more systematic than the one used 
at UM, may be useful for determining relevant KSIs. First, use an organizational chart to 
get an overview of all the functions or operations in the institution. Next, contact senior 
administrators with responsibilities for these areas and ask them four questions: Wliicfa 
functions reporting to them are the highest priority and the most critical to the success of 
the institution? Which types of measurement (e.g., volume, accuracy, efficiency, timeliness, 
customer satisfaction) are most importani for measuring how well each of these functions 
is performing? Are there any measurements that in the past have produced some "surprises" 
at the end of the year and therefore should be included? Whom would they recommend 
as a contact person to supply the data? Or :e identified, the contacts also should be asked 
several questions: What type of measurement is most important for evaluating their 
operations? What specific data should be used to measure the performance of their offices? 
Are such data available on a monthly basis? Notice the availability of data is determined 
only after deciding which data are most important. 
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Step 3**Identifyiiig contacts in offices supplying the information. Several 
characteristics are important for KSI contacts. First of all, they must be able to supply the 
data needed for the report. Sometimes the office in charge of a given operation may not 
be the best source of official data dealing with that operation (e.g*, although the sponsored 
research office at UM has been the source of the number and the amounts of grant 
proposals and awards received, the budget office has been the contaa for the official 
numbers for sponsored-research expenditures)* 

Two other important characteristics are a cooperative attitude and a track record for 
meeting deadlines. The KSI report means extra work for the contact person when the 
report is first created plus each month thereafter* When the report is first set up, the 
desired data may not be readily available and therefore may need to be reconstmcted for 
the current as well as for the pnoryear. Furthermore, changes in the reporting format may 
occur in the future, requiring even more work. If an office is habitually late each month, 
consider asking if someone else in the office Vho is less busy" can supply the data in a more 
timely manner. Sometimes a KSI contact will be reluctant to share data, even with senior 
university officials. In this case, invoking the assistance (or even the name) of the advocate 
identified in Step 1 or a senior administrator contacted in Step 2 can inaease the willingness 
to supply the data* 

Two final characteristics are a thorough knowledge of the data collection and report 
preparation process, and sensitivity to nuances in the data* Often, changes that show up in 
the KSI report are merely the result of variations from one year to the next in how data are 
collected or reported. Since the contacts will be asked to explain differences, it is important 
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that they understand the data«*reporting process well enough to be able to distinguish real 
changes in data from apparent differences merely resulting from variations in the reporting 
process (e.g., variations in the timing, grouping, or rules for calculating the data). 

Step 4-Determmiiig the format for the report. Table 2 shows the layout of the 
report used at the University of Miami. The first set of numbers shows current year-to-date 
figures and the changes (absolute and percentage) from the previous year. The second set 
shows current monthly data and the changes from the previous year. Actual prior year 
amounts and budgets (total budget plus a pro-rated year-to-date budget) also appear on the 
report. The KSI presentation at UM concentrates on the year-to-date numbers, and in 
particular on the percentage changes from the previous year. Because the UM report 
contauiS many ^.umbers, other institutions developing the report may prefer to simplify the 
report format by including only the current year-to-date numbers, the actual and the 
percentage changes from the previous year, and the year-to-date budget numbers. If omitted 
on the formal report, the monthly, prior year, and/or total budget data could still be 
available to the presenter in case a question arises about any of these numbers during the 
presentation. 

Step S-Setting up a spreadsheet to prod^^ce the report At UM the KSI report is 
prepared using a computer spreadsheet divided into five sections: the formal report, the 
current year-to-date (YTD) data, the current monthly data, the prior year's YTD data, and 
the prior year's monthly data (the layout appears in Table 3). Each month, data are entered 
into the appropriate columns of the current YTD section of the spreadsheet Current 
monthly figures are calculated by subtracting the previous month's YTD figures firom the 
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current month's YTD figures. At the end of each year, the prior YTD amounts are "rolled 
over" from the previous year's data (although some offices prefer to provide comparable 
prior-year data each month). Prior monthly figures are computed from prior YTD figures. 

Most ot the numbers in the report section are formula-driven. The current year-to- 
date and the current monthly figures in the report are extracted from other sections of the 
report. The total budget amounts are entered manually, where appropriate, and the 
estimated YTD budget amounts are calculated by prorating the total budget amount by the 
proportion of the prior year's year-end total that had been accumulated by the same month 
last year.* 

Step 6*«Developing an information-coUection process. When the KSI report was first 
developed at UM, offices supplied data each month via memos, copies of existing reports, 
and telephone calls. Along the way, UM developed a pre-printed data collection form 
(Table 4) to help with the coUeaion of data. Although some offices have continued using 
their own forms or memos, many now use this form. Data are collected by the 15th of the 
month via fax or interoffice mail. When necessary, staff members make follow-up telephone 
calls to remind KSI contacts to send in their data and more importantly to ask about any 
unexpectedly large chaiiges in the data. 

Using the same data-collection form for each office is strongly recommended because 
all the data from the different offices wUl then appear in the same format. Furthermore, 



To expedite the development of a KSI report, a Lotus 1-2-3 spreadsheet containing 
formulas and sample data plus an accompanying manual can be obtained from the Office 
of Planning and Institutional Research at the University of Miami. Call 305-284-3856 for 
more information. 
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the form provides the contact office with a history of numbers so if a different person from 
that office submits the data, tbey can refer to previous data to be sure the data they are 
supplying are comparable and consistent with earlier data. In addition, any major 
discrepancies between new data and prior month's data can be easily spotted by the contact 
office before the new data are sent. 

Step 7-Preseiiting the report. The ICSI report is circulated to the participants of 
UM's agenda committee (Table 5) a few days prior to the KSI meeting, and only highlights 
of the report (i.e., large deviations in current data from the prior year or budget) are 
discussed at the meeting. Graphs showing monthly trends in student accounts receivable, 
indirect cost recovery by campus, tuition remission, and average net cash position also are 
presented. Excluding questions and discussion, the presentation usually takes about 30 
minutes. Questions during the presentation and the ensuing discussion sometimes lengthens 
the entire presentation to an hour. 

Actual preparation for the presentation (including a final edit of the report before 
it is sent out) takes less than 30 minutes. First a highlighter is used to mark the following: 

1) any percentages in the "% BETTER (WORSE)" column of the YTD section that 
represent large changes from the prior year (usually 5 points or more in either direction), 

2) any KSIs for which the trend on the report is different from the trend on the prior 
month^s report, 3) any KSIs which are especially timely. One reason the presentation itself 
goes quickly is that fewer than half of the KSIs are discussed at any given meeting. Early 
in the fiscal year, financially oriented KSIs are often skipped or mentioned only in passing; 



similarly, early in the enrollment calendar, data for new students are considered too 

preliminary to be discussed. 

If ihere is a major trend (especially in the negative direction), the reporting office is 
asked to provide any explanations or comments they wish to have passed on at the KSI 
meeting. The presentation itself requires merely "narrating" those KSIs that have been 
highlighted and providing any explanations from the reporting office that have been 
summarized on a separate numbered list and cross-referenced in the margin of the 

presenter's KSI report. 

The KSI meeting has become an opportunity to present other topics related to areas 
covered in the KSI report such as summaries of data comparing UM with other independent 
universities, results of student surveys, trends in the numbers of employees, and other similar 
topics. UsuaUy the director of planning and institutional research makes these 
presentations, but sometimes other participants wiU give a short presentation. 

Over time, participants have become more involved with the report. Vice presidents 
with responsibility for the areas covered in the report now come to the KSI meeting 
prepared to comment or to offer explanations regarding their areas. The president also has 
started taking the initiative in noting changes in KSIs. 

Step 8~Modi?yiiig the report. At UM the KSI report has changed over time. New 
KSIs have been added, and others have been reformatted (e.g., payroU information originaUy 
was reported by employee classification within source of funds; currently, payroU is reported 
by source of funds within employee classification, and the Medical School payroU data are 
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reported separately). Other institutions developing a KSI report should be sensitive to the 
need to fine tune and to add (or to delete) BCSIs. A formal evaluation after a year may be 
useful 

POTENTIAL OBSTACLES 

A potential obstacle to development may be lack of interest from senior 
administration. This obstacle is the primary reason for finding an advocate who will help to 
spearhead the cause. A well-placed ally can ensure interest in the project and can assist 
with obtaining cooperation from offices less than eager to supply data for the report. 

Another obstacle that may be encountered is lack of cooperation from contacts in 
offices supplying information. Some of the offices supplying the data are overworked and 
will not be happy about the prospect of collecting additional monthly data. Contacts should 
be chosen carefully and possibly replaced if problems arise. The assistance of a vice 
president can help increase cooperation. 

A third possible obstacle is that the best data from the previous year, and even for 
the current year, may not exist in the format desired If data from the previous year are 
either not comparable or are not on file, the reporting office should be asked to reconstmct 
the data in a format comparable to what is used in the current year. As a rule, the quality 
of data is more important than the availability of the data. If the 'l)est*' data are not 
available at all, even for the current year, another set of data could be used on a temporary 
basis until a complete set of the 'l)est" data is computed, at which point the new set of data 
can be substituted in the report. If a year-to-date budget can be computed, the current data 
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can be compared to the year-to-date budget, making the absence of prior-year data less 
important 

Finally, some data required for the report are of a sensitive nature, and those 
responsible may not want the data shared with others (or even written in a report). As a 
means to ensure confidentiality at UM, the report is hand-delivered a few days in advance 
to the people who will attend the meeting (never faxed or sent via interoffice mail), and the 
report and transmittal envelope are labeled "confidential." At the end of the meeting, 
copies of the report are collected and destroyed. Sinular steps should be taken at other 
institutions to ensure confidentiality. 

FREQUENTLY ASKED QUESTIONS 

One question asked about the data-collection process at UM is why the office 
producing the report does not simply download the data or obtain the data directly from 
computer printouts, thereby bypassing the contact office. The decision to have the KSI data 
supplied each month by the office with responsibility for the function being measured not 
only saves time for the office responsible for producing the report but also gives the 
reporting office a sense of ovraership, responsibility, and importance. It is easier, faster, and 
more accurate for the office with responsibility for the data to explain why a KSI has 
changed significantly from the preceding month if they have supplied the data themselves. 

A second question about the KSI report is how much time is required to develop and 
to produce the report. Because the director of planning and institutional research at UM 
wanted the monthly preparation of the KSI report to take as Uttle time as possible and 



ERLC 



15 



12 

wanted it to be the kind of task that could be delegated to a staff member, extra effort was 
spent up-front on designing a spreadsheet in such a way as to make the monthly report 
preparation fast and easy. At UM, development of the KSI report took place over a two- 
to three-month period. As a result, now that the process has been set up and is running, 
entering and checking the data and printing the report and graphs take a staff person only 
about four-five hours (spread over the third week of each month). Occasionally, additional 
time is required to follow through with the KSI contacts on any questions about the data. 
Only about 15-30 minutes are spent preparing for the presentation, 

A third question is which office should prepare the report. The reporting office 
should have the support of the central administration, be viewed as objective, and have 
experience collecting data from a number of sources. In order to avoid embarrassment and 
loss of credibility, it is especially important that the reporting office have experience spotting 
"anomalies" in data that may be the result of errors in reporting rather than real differences. 
Institutional research offices can be ideal for this role. 

BENEFITS 

Although a KSI report is time-consuming to plan and to develop and requires 
monthly coordination of a large number of offices around the campus, it does have 
important benefits. As with other planning projects, the process relating to the KSI report 
has been more valuable than the report itself. 

The official reason for producing a KSI report is to alert senior management to any 
key areas of the institution that are "out of control" and to raise questions about situations 
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at an early stage before problems arise. Major changes in an index can prompt questions 
about what is happening and may lead to a change in policy (or at least in budget). For 
example, at UM the KSI report has shown at an early stage both negative and positive 
trends in undergraduate and graduate enrollments, sponsored research, revenue in the 
School of Continuing Studies, accounts receivable, payroll, and cash flow. In fact, in several 
cases, having to compute the data for the KSI report alerted the reporting office itself about 
a change. In the absence of a formal report, monthly trends can be lost in the need to 
perform daily operations. 

In addition to accomplishing the official purpose for the report, the KSI project can 
yield more subtle benefits related to education, team building, accountability, and visibility. 
Some of these tacit benefits were in fact among the "unofficial goals" of the KSI report at 
UM. For example, the KSI report has proved to be a useful tool to help managers at UM 
think about the basics of the university in ways trustees and other executives think. It causes 
the senior officers who receive the report to focus on the same key information and helps 
to educate senior managers about other areas of the university outside their direct 
responsibility. This heightened understanding of other areas leads in tum to an increased 
sense of teamwork among the senior administrators. The senior vice president at UM 
describes the KSI report as a "point of departure, a vehicle for bright managers to 
understand information and ask questions." Tho^^. who attend the KSI meetings at UM 
have become more aware of what is happening in other areas and sometimes even comment 
on another area. 
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The KSI rcDort also reminds the offices providing the data that they are accountable 
for the management of their operation. Often just knowing that someone is measuring a 
process will cause it to improve. Most offices at UM are pleased the senior administration 
wants to include their data in a monthly meeting with the president. Therefore, they not 
only provide the data, but are helpful in providing answers to any questions. 

An incidental benefit to the office producing the report will be to increase its 
visibility, not only with the senior officers of the university, but also with other offices 
around campus. Furthermore, the office preparing the report will have a better 
understanding of and access to important overall university data than it did before, a 
condition that makes the office-and the university-more effective and more able to meet 
the challenges of the 1990s. 
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TABLE 1 



KEY SUCCESS INDICES-TOPICS 



Number of new freshmen and transfers who applied, were admitted, and verified 
Housing applications for new freshmen, transfers, and continuing degree undergraduates 
Financial aid offered and accepted for new freshmen, new transfers, and graduate smdents; 

total financial aid expenditures for the current year 
Return rates for new freshmen and for degree undergraduates 
Fall-to-spring ratio for undergraduate and graduate mition 
Number of business graduate smdents who applied, were admitted, and verified 
Number of education graduate smdents who applied, were admitted, and verified 
Number of law graduate smdents who applied, were admitted, and verified 
Revenue for the School of Continuing Smdies 
Student accounts receivable amounts 

Sponsored research number of proposals, amount and number of awards received, by 

individual campus and total 
Indirect cost recovery by individual campus and total 
Direct cost recovery by individual campus and total 

Gifts by purpose and individual categories (current unrestricted, current restricted, plant, 
loan, endowment, annuities and trusts, trusts held outside) by campus and total 

Professional Income Practice charges, receivables, coUections, expendimres, and surplus/ 
deficit 

PubUc health receivables for 30 days, 60 days, 90 days, and total 
Estimated cost of losses from medical malpractice, general liability, and other lawsuits bemg 
defended 

Payroll by classification of employee, source of funds, and campus 
Number of employees by campus and type (medical and non-medical) 
Tuition remission costs 
Accoimts payable 
Cash flow analysis 

Y?ar Fnd Forecasts 
Total financial aid expenditures 
Continuing Studies end of year net total revenue 
Proiected indirect cost recovery for each campus and total umversity 
rrojeaed budget variance for current ftmds, general fimds, designated funds, restncted 
funds, and total 
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TABLE 4 

KEY SUCCESS INDICES DATA REQUEST FORM 
SANDRA RAFF, PAYROLL OPERATIONS (284-3664) 

FYJ992^ jyNE JJJljr AUGUST SEPTEHE.ER OCTOBER NpVEMBER 
Nurbtr of Monthly Employtes 

Medical — 

Non-Htdic»l 

Number of Biweekly Eirployees 

Medical 

Non-Medical 



DECEMBER JANUARY FEBRUARY MARCH APRIL MAY 

Number of Monthly Employees 

^^edical 

Non-Medical — ^ 

Nunber of Siueekly Enployees 

Medical 

Non-Medical 



FY 1991*92 JUNE JULY AUGUST SEPTEMBER OCTOBER NOVEMBER 

Nonber of Monthly Employees 

Medical j 

Non-Medical 

Nonber of Biweekly Employees 

Medical 

Non-Medical 

DECEMBER JAN\JARY FEBRUARY MARCH APRIL MAY 

Nonber of Monthly Employees 

Medical — 

Non-Medical . ■ 

Nonber of Biweekly Employees 

Medical 

Non-Medical . ^ — 

Return to: ICerry Foster. Prtgrwamr Analyst 
Ibi. 341,un8ar BldQ., 2^^-2945 
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TABLE 5 

LIST OF PEOPLE ATTENDING KSI MEETING 



• President 

• Executive Vice President «& Provost 

• Senior Vice Presidents (Business & Finance and Medical 
Affairs) 

• Vice PresidePxts (University Advancement, Government 
Relations, General Counsel, Treasurer, Information 
Resources, Student Affairs) 

• Vice Provosts 

• Assistant Vice Presidents (Business Services and Facilities 
Administration) 

• Assistant Secretary of the University 

• Director (Planning & Institutional Research) 
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